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ABSTRACT 


Cooperative  decentralized  control  of  autonomous  vehicles  continues  to  be  an  important  research 
subject  for  many  military  and  civilian  applications.  Vehicles  can  communicate  with  each  other 
and  exchange  information  about  their  relative  positions,  target,  environment,  and  use  that  data  to 
develop  decentralized  but  coordinated  control  policies.  Communication  is  often  represented  by 
an  information  graph,  and  infonnation  exchange  is  modeled  by  a  discrete-time  dynamical 
system,  known  as  the  information  loop.  When  the  vehicles  all  agree  on  the  information  state  it  is 
said  that  they  have  reached  an  infonnation  “consensus,”  which  is  equivalent  to  conditional 
stability  of  the  infonnation  loop.  Often  consensus  control  is  slow  to  converge  or  easily 
destabilized.  Being  able  to  assess  the  quality  of  communication  topologies  (information  graphs) 
is  critical  to  determining  the  quality  of  a  consensus  solution. 

In  this  work  a  topological  manifold  approach  for  representing  complex  networks  of  dynamical 
entities  is  shown  to  be  an  effective  way  to  represent  non-entropic  measures  of  information  as  low 
dimensional  embeddings  in  a  high  dimensional  lifted  space.  A  2  dimensional  embedding 
(stability  margin  -  convergence  rate)  was  developed  that  demonstrates  an  efficient  frontier  of 
graph  topologies  that  dominate  all  others  in  their  ability  to  reject  disturbances  and  converge 
rapidly  to  a  consensus. 
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Introduction 


The  study  of  information  dynamics  is  important  for  understanding  complex  networks  of 
dynamical  systems  with  infonnation  flows  and  shared  or  coordinated  control  policies. 
Infonnation  dynamics  is  essentially  the  study  of  information  flows  in  a  network  when  modeled 
as  a  discrete-time  dynamical  system.  Control  policies  that  shape  the  dynamics  of  the 
information  flows  in-turn  shape  the  system  dynamics  of  the  physical  entities  within  the  network 
(e.g.  fonnations,  shared  tasks).  Vehicle  communication  is  often  represented  by  a  communication 
or  infonnation  graph,  and  because  of  possible  delays  in  infonnation  processing  and  transmission, 
information  exchange  is  modeled  by  a  discrete-time  dynamical  system,  known  as  the  infonnation 
loop.  Ensuring  desired  stability  and  convergence  properties  of  the  information  loop  is  critical  to 
efficient  performance  of  a  cooperative  system.  When  the  vehicles  all  agree  on  the  information 
state  it  is  said  that  they  have  reached  an  infonnation  “consensus” 

Optimizing  the  convergence  rate  of  the  information  flow  in  consensus  problems  for  various 
networks  has  long  been  an  active  research  venue.  On  the  other  hand,  stability  of  information 
flow  in  application  to  cooperative  control  of  vehicle  formation  was  comprehensively 
investigated,  and  a  general  method  for  deriving  transfer  functions  for  closed-loop  multi-agent 
systems  was  recently  suggested.  However,  often  improvements  of  the  convergence  rate  lead  to 
degrading  stability  and  vice-versa.  Both  stability  and  convergence  are  important  characteristics 
of  the  information  flow  and  should  be  analyzed  together.  This  work  develops  an  optimization 
framework  for  stability  and  convergence  of  the  infonnation  flow  in  cooperative  systems  and  also 
investigates  the  impact  of  the  topology  of  the  communication  graph  on  the  stability  margin  and 
convergence  rate.  The  set  of  all  graphs  that  that  dominate  all  others  in  their  ability  to  reject 


disturbances  and  converge  rapidly  to  a  consensus  was  computed.  This  set  is  the  efficient  frontier 
or  Pareto  solution  set.  A  high  dimension  “information  space”  may  be  constructed  such  that  a 
point  in  this  space  corresponds  to  one  possible  graph  and  all  possible  graphs  on  n-nodes  spans 
the  space.  The  Pareto  solution  set  is  shown  to  be  a  2  dimensional  manifold  on  the  information 
space. 

The  problem  to  be  addressed  is  formulated  as  follows.  Suppose  there  are  n  vehicles  in  a 
cooperative  system.  Let  vector  Xi=(xii,...,Xim)T  determine  position  of  vehicle  i  in  m-dimensional 
space,  and  let  X  =  (xi,...,xn)  be  an  m*n  matrix  describing  position  of  the  whole  system. 
Communication  in  the  system  is  represented  by  a  directed  communication  graph  G=(V,E)  with  V 
and  E  being  the  sets  of  vertices  and  edges,  respectively,  where  node  i  represents  vehicle  i  and  the 
edge  from  i  to  j  shows  that  vehicle  j  receives  information  from  vehicle  i  (or  “watches”  vehicle  i). 
Let  N;  be  the  set  of  outgoing  edges  of  vertex  i  with  |Ni|  the  cardinality  of  Nj.  The  nonnalized 
adjacency  matrix  G  and  the  nonnalized  Laplacian  L  of  G  are  defined  as  follows: 


G  =  tev}7j=i, 

L=I-G , 


/  I  Ail"1,  jeNh 

\  0.  jgNiU{i}, 


where  I  is  the  identity  matrix. 


Let  yk  =  (yik,  .  .  .  ,ynk)  be  an  error  vector,  in  which  component  yik  represents  the  error  between 
an  internal  state  measurement  of  vehicle  i  and  a  time-varying  offset  function  h;(k)  relative  to  an 
arbitrary  reference  at  time  mo  ment  t  =tk.  For  example,  y,i<  =  1 1 Cx i (k) — h i (k) 1 1 ,  where  C  is  a  matrix 
and  x;(k)  is  the  position  of  vehicle  i  at  t  =  tk.  Also,  let  vector  pk  denote  information  transmitted 


to  the  vehicles  at  t  =  tk.  The  information  flow  in  the  cooperative  system  can  be  represented  by  a 
discrete-time  linear  dynamical  system  (infonnation  loop) 


=  Z  a jVk-j  +  GPi  +  L)’k ,  k  =  0,1, 

7=0 

M 

Pk  =  HbjPk-r  k  =  0,1,... 


with  qk  =  0  for  k  =  -M, . 


j= o 

. ,  0;  see  [7]. 


(1) 


We  pose  the  following  questions: 

(i)  Given  a  communication  graph  G,  what  is  the  best  possible  convergence  rate  for  the 
information  loop  in  (1)? 


(ii)  Given  a  communication  graph  G,  what  is  the  tradeoff  between  the  convergence  rate  and 
stability  margin  as  a  function  of  the  infonnation  control  gains  aj  ,b,  ,  j  =  0, .  .  .  ,M? 

(iii)  Given  a  finite  set  of  graphs  on  “n”  vertices,  what  is  the  best  topology  of  the  communication 
graph  G  with  respect  to  both  the  convergence  rate  and  stability  margin?  Find  an  ordering  of  these 
graphs,  from  best  to  worst,  that  illustrates  how  some  graphs  can  dominate  others. 


Convergence  Rate. 

Conditional  convergence  for  a  discrete  LTI  system  is  given  as  follows:  G  has  exactly  1 
eigenvalue  Xi=l  with  eigenvector  1 N  ,  all  other  eigenvalues  are  strictly  within  the  unit  disk. 
Conditional  convergence  is  equivalent  to  “consensus”  for  an  LTI  infonnation  dynamical  system. 


M  M 

Let  lim p,  =  p* ,  lim qk  =  q  ,  limj^.  =  y  ,  a  =  Va.,  b  =  Vb.  and  c  =  (l-a)/b 

A:— >00  A:— >oo  A:— >co  J  J 

7=0  7=° 

Then  q  =  aq  +  Gp*  +  Ly  ,  p*  =bq 
If  c  is  an  eigenvalue  of  G  it  must  be  1  and  unique  with  e. vector  lN ,  can  be  shown 
p  =y+  y\N  with  y  scalar  multiplier  that  determines  convergence 

Define  the  block  diagonal  matrix 


0  = 


N0 

I 

0 


Nx 

0 

/ 


0  0 


N m~\  Nm 

0  0 

0  0 


where 


Nj=aJI  +  bJG 


/  0 


(2) 


If  Q  meets  conditional  stability  (simple  eigenvalue  of  1,  all  others  within  unit  disk)  then  p*  is 
guaranteed  to  converge  to  p*  =  y  -  ry*ln  with  r  left  eigenvector  of  G:  rln  =  1 


n{M  +  1)  eigenvalues  of  matrix  Q  found  from  roots  of  characteristic  polynomials: 


M 


Pk(s)  =  sM+'  -Y,(aj+Xkbi): 

7=0 


M-j 


=  0  for k  =  1,2,... ,n 


with  roots  skj  such  that  sn  =1,  and  otherwise 
Now  define  generalized  convergence  rate  as: 


<  1  when  conditionally  stable 


£  =  1  —  max  \skj\ 

11  =  1 


(3) 


which  has  exact  expressions  for  low  order  (M=0  or  1)  controllers  but  becomes  intractable  for 
higher  orders  (however,  it  is  conjectured  that  higher  order  controllers  would  have  limited 
additional  benefit).  For  instance,  for  M=0 


e  =  1  —  max  1 1  —  2>o  +  o  I 

fr=2,...,n 


(4) 


The  maximal  convergence  s*  can  be  found  over  all  strongly  connected  graphs  by  solving  a 
quadratic  optimization  program.  It  was  also  proven  that  only  the  complete  graph  has  the  fastest 
convergence,  8=1. 


Stability  Margin 


To  obtain  a  measure  of  stability  margin  without  resorting  to  gain  and  phase  margins,  we  first 
obtain  a  closed  loop  transfer  function  by  taking  Z-transfonn  as: 

r  M  \(f  M  \  f  M  h  h  ' 

P(z)=  Yjbjz'j  -  T,ar  '  J-  Tjbjz~J  G  LY(z ) 

\J=°  j= 0  J  \J=°  J  J 

00 

P(z)  =  F{z)Y (z)  where  P(z)  =  ^  pkz ~k ,  and  similar  for  Q(z),  Y (z) 

k=0 


The  open  loop  (forward  path)  transfer  function  is  then: 

F(z)  =  (/  +  O(z))  1  ®(z),  or  O(z)  =  F(z)(/-f7(z))  ’ 

Now  compute  the  inverse  of  the  sensitivity  function  (defined  as  the  magnitude  of  this  vector 
from  -1  to  the  closest  point  on  the  Nyquist  curve  plotted  for  the  open  loop  transfer  function): 

S  =  (/  +  ®(z))  1 ,  with  Smax  =  max  (/  +  0(z))  so  Sm  =min|/  +  0(z)| 

From  this  the  stability  margin  is  defined  as: 


Pareto  Framework. 


Now  we  turn  to  constructing  the  2-dimensional  manifold  or  efficient  frontier  of  convergence  rate 
and  stability  margin.  For  a  graph  G,  we  can  fonnulate  the  following  constrained  optimization 
problem: 


8/7(6)  =  max  min  min 
'  a0 . a.u/c=  2 . nM=l 


Pk(z) 

Pl(~) 


s.t. 


ki/l  <  1  -  Pi(su)  =  0, 


ktal  <l-e,  Pk(Ski)  =  0, 
SjLo  (aj  +  bj)=U 


i  =  2 . M+  1,  M>  1, 

1  =  1,  k=  2 . n,  M >  0, 


Which  has  a  solution  that  optimizes  controller  gains  aj  and  bj  to  find  the  maximal  stability 
margin  5*G(s)  for  s  G  (0,s*].  This  is  the  efficient  frontier. 


Results. 


An  efficient  frontier  was  computed  for  the  example  graphs  in  Figure  1 .  The  results  are  in  Figure 
2  and  3. 


Figure  1:  Example  Graph  Topologies  on  6  Nodes. 


5*  <5* 


Figure  2.  Efficient  Frontier  For  Graphs  in  Figure  1  with  M=0 


<5" 


Figure  3.  Efficient  Frontier  For  Graphs  in  Figure  1  with  M=1 


As  can  be  seen,  the  complete  graph  always  dominates  but  other  graphs  do  show  dominating 
effects  as  well.  These  results  show  how  stability  margin  can  be  traded  for  convergence  rate  and 
vice  versa.  For  the  zero-order  information  loop  and  all  strongly  connected  communication 
graphs,  efficient  frontiers  have  been  found  analytically,  while  for  the  first-order  information  loop 
and  undirected  communication  graphs,  they  have  been  evaluated  numerically.  The  result  that  the 
complete  graph  has  the  highest  convergence  rate  and  the  best  efficient  frontier  can  be  related  to 
the  fact  that  the  normalized  adjacency  matrix  of  the  complete  graph  has  the  minimal  number  of 
distinct  eigenvalues.  In  other  words,  the  more  distinct  eigenvalues  the  nonnalized  adjacency 
matrix  of  a  graph  has,  the  more  constraints  on  control  gains  in  the  information  loop  are  imposed, 
and  consequently,  the  lower  maximal  convergence  rate  and  maximal  stability  margin  are.  The 
complete  graph  is  the  primal  choice  for  vehicle  communication.  However,  if  for  some  reason,  it 
cannot  be  afforded,  numerical  results  show  that  the  “star”  graph  is  the  next  best  choice. 
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